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DESCRIPTION 
Transcoding Apparatus, Method and Medium 

Technical Field 

The present invention relates to a transcoding apparatus, method and medium, 
and more particularly to a transcoding apparatus, method and medium, for converting 
codes used in a transport stream having multiplexed therein a video stream, audio 
stream and other data stream. 
Backgi'ound Art 

In the satellite digital television broadcasting and the ground-wave digital 
television broadcasting which is going to start soon, a transport stream (will be 
referred to simply as "TS" hereinafter) confonning to the MPEG (Moving Pictures 
coding Experts Group) 2 systems (ISO/IEC 13818-1) (will be referred to as "MPEG- 
2" hereinafter), is used as the broadcast wave. TS as the broadcast wave has 
multiplexed therein a video stream, audio stream and other data stream. 

When TS as the digital television broadcast wave is recorded into a recording 
medium, a bit rate changer as shown in FIG. 1 is used to reduce the code bit rate for 
a to-be-recorded TS if the data recording rate into the recording medium is lower than 
at a bit rate at which the TS is to be recorded. Note that since the bit rate changer 
ftmctions to convert the code bit rate, it is a kind of transcoder for converting codes 
of an input stream. 
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ATS demultiplexer 1 included in the bit rate changer shown in FIG. 1 separates 
an input TS via an input tenninal IN into a video stream VS and audio stream AS and 
supplies them to an MPEG video decoder 2 and MPEG audio decoder 4, respectively. 

The MPEG video decoder 2 decodes the supplied video stream VS to provide 
a video signal and supplies the video signal to an MPEG video encoder 3 . The MPEG 
video encoder 3 will encode the supphed video signal to a video stream having a 
predetermined bit rate by the MPEG method, and supply the encoded video stream to 
a TS multiplexer 6. On the other hand, the MPEG audio decoder 4 decodes the 
supphed audio stream AS supplied to provide an audio signal and supplies the audio 
signal to an MPEG audio encoder 5. The MPEG audio encoder 5 will encode the 
supplied audio signal to an audio stream having a predetennined bi rate by the MPEG 
method, and supply the coded audio stream to the TS multiplexer 6. The TS 
multiplexer 6 will multiplex the video stream supplied from the MPEG video encoder 
3 and the audio stream supplied from the MPEG audio encoder 5 to provide a TS' 
having a reduced bit rate. The TS' is delivered at an output tenninal OUT. 

However, the conventional bit rate changer shown in FIG. lis disadvantageous 
in that when an input TS contains any elementary streams not confrinning to MPEG-2, 
the TS, once separated into elementary streams, cannot be re-multiplexed. For 
example, a private stream such as a data stream used in the digital television 
broadcasting is not confonning to MPEG-2, and each of service providers uniquely 
sets necessary buffer size and bit rate for multiplexing. No multiplexing is possible 
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when the TS muhiplexer 6 does not understand the buffer model for a stream to be 
multiplexed. Therefore, it is difficult to multiplex a private stream such as data stream 
for example except when the buffer model of the stream is already known. 

Also, the conventional bit rate changer shown in FIG. 1 has a problem that it 
can change the bit rate of a transport stream TS having multiplexed therein one video 
stream VS and one audio stream AS, each confonning to MPEG-2 but cannot change 
the bit rate of a TS having multiplexed therein one video stream VS and a plurality of 
audio streams AS. 
Disclosure of the Invention 

Accordingly, the present invention has an object to overcome the above- 
mentioned drawbacks of the prior art by enabling to separate an input TS containing 
any elementary streams not confonning to MPEG-2 into elementary streams and re- 
multiplex the elementary streams. 

The present invention has another object to pennit to change the bit rate of a TS 
having multiplexed therein a plurality of elementary streams besides video streams. 

The above object can be attained by providing a transcoder for generating, from 
a first multiplexed stream, a second multiplexed stream, including according to the 
present invention: 

means for separating a first elementary stream from the first multiplexed stream 
supplied; 

means for converting the first elementary stream separated by the separating 
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means by a predetemiined method to a signal; 

means for packetizing the signal converted by the converting means to generate 
a first packet; 

means for storing timing information indicating a time at which a packet, 
containing a second elementary stream foniiing the first multiplexed stream, appears 
in the multiplexed stream; and 

means for multiplexing, based on the timing information stored in the storing 
means, the first packet generated by the packetizing means and a second packet 
containing the second elementary stream to generate the second multiplexed stream. 

In the above transcoder according to the present invention, the converting 
means includes: 

means for decoding the first elementary stream separated by the separating 
means to generate an original signal corresponding to the first elementary stream; and 

means for encoding the original signal generated by the decoding means at a 
predetennined bit rate. 

Also in the above transcoder, the converting means converts, by a 
predetennined method, codes forming the first elementary stream separated by the 
separating means. 

Also in the above transcoder, the multiplexing means multiplexes, based on the 
tiining information stored in the storing means, the second packet to the second 
multiplexed stream at a time corresponding to the time at which the second packet 
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appears in the first multiplexed stream. 

Also the above object can be attained by providing a transcoding method for 
generating, from a first multiplexed stream, a second multiplexed stream, including, 
according to the present invention, steps of: 

separating a first elementary stream firomthe first multiplexed stream supplied; 

converting the first elementary stream separated at the separating step hy a 
predetennined method to a signal; 

packetizing the signal converted at the converting step to generate a first packet; 

storing timing information indicating a time at which a packet, containing a 
second elementary stream fonning the first multiplexed stream, appears in the 
multiplexed stream; and 

multiplexing, based on the timing infonnation stored at the storing step, the first 
packet generated at the packetizuig step and a second packet containing die second 
elementary stream to generate the second multiplexed stream. 

In the above transcoding method according to the present invention, the 
converting step includes steps of: 

decoding the first elementary stream separated at the separating step to 
generate an original signal corresponding to the first elementary stream; and 

encoding the original signal generated at the decoding step at a predetennined 
bit rate. 

Also in the above transcoding method, at the converting step, codes forming the 
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first elementary stream separated at the separating step are converted by a 
predetemiined method. 

Also in the above transcoding method, at the multiplexing step, the second 
packet is multiplexed to the second multiplexed stream at a time corresponding to the 
time at which the second packet appears in the first multiplexed stream based on the 
tiining information stored at the storing step. 

Also the above object can be attained by providing a medium having recorded 
therein a transcoding program to generate, fi"om a first multiplexed stream, a second 
multiplexed stream and which is to be executed by a computer, the program including, 
according to the present invention, steps of: 

separating a first elementary stream firom the first multiplexed stream supplied; 

converting the first elementary stream separated at the separating step by a 
predetennined method to a signal; 

packetizing the signal converted at the converting step to generate a first packet; 

storing timing information indicating a time at which a packet, containing a 
second elementary stream fonning the first multiplexed stream, appears in the 
multiplexed stream; and 

multiplexing, based on the timing infomiation stored at the storing step, the first 
packet generated at the packetizing step and a second packet containing the second 
elementary stream to generate the second multiplexed stream. 

In the above medium according to the present invention, the converting step in 
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the program includes steps of: 

decoding the first elementary stream separated at the separating step to 
generate an original signal corresponding to the first elementary stream; and 

encoding the original signal generated at the decoding step at a predetermined 
bit rate. 

Also in the above medium, at the converting step in the program, codes fonning 
the first elementary stream separated at the separating step are converted by a 
predetennined method. 

Also in the above medium, at the multiplexing step in the program, the second 
packet is multiplexed to the second multiplexed stream at a time corresponding to the 
time at which the second packet appears in the first multiplexed stream based on the 
timing infiDrmation stored at the storing step. 

These objects and other objects, features and advantages of the present 
invention will become more apparent from the following detailed description of the 
preferred embodiments of the present invention when taken in conjunction with the 
accompanying drawings. 
Brief Description of the Drawings 

FIG. 1 is a block diagram of a conventional bit rate changer, showing an 
example of its construction. 

FIG. 2 is a block diagram of an embodiment of the transcoder according to the 
present invention. 
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FIG. 3 is a block diagram of a code converter included in the transcoder in FIG. 

2. 

FIG. 4 is a block diagram of a TS recorder using the transcoder in FIG. 2, 
showing an example of its construction. 

FIG. 5 explains the operation of the TS recorder in FIG. 4. 

FIG. 6 is a flow chart of operations effected in switching control by a controller 
included in the transcoder in FIG. 2. 

FIG. 7 is a block diagram of another embodiment of the transcoder according 
to the present invention. 

FIG. 8A shows a personal computer incorporating a recording medium having 
stored therein a transcoding program. 

FIG. 8B explains the recording medium used to install the transcoding program 
into the personal computer and enable the execution of the program. 

FIG. 80 explains a system used to install the transcoding program into the 
personal computer and enable the execution of the program. 

FIG. 9 is a block diagram of the personal computer, showing its internal 
construction. 

Best Mode for Carrying Out the Invention 

Referring now to FIG. 2, there is illustrated in the form of a block diagram an 
embodiment of the transcoder according to the present invention. This transcoder is 
to generate, from a first transport stream TS suppHed as an input, a second transport 
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stream TS'. The first transport stream TS is a one having multiplexed therein a video 
signal transport stream packet as a first elementary stream (will be referred to as 
"video TS packet VTSP" hereinafter) and non-video TS packets UVTSP including 
audio stream and other data stream. 

As shown in FIG. 2, the transcoder includes a video TS packet separator 10 to 
separate the video TS packet VTSP from the first transport stream TS supplied from 
an input tenninal IN, a code converter 12 to convert, by a predetennined method, 
codes fomiing the video TS packet VTSP separated by the video TS packet separator 
10, a TS packet generator 15 to generate a code-converted video TS packet VTSP' by 
packetizing the signal whose codes have been converted by the code converter 12, a 
TS timing manager 1 8 to store timing information indicating a time at which the packet 
including the non-video TS packets UVTSP fr)miing the first transport stream TS 
appears in the first transport stream TS, and a switch 16 to generate, and deliver at an 
output terminal OUT, the second transport stream TS' by multiplexing the video TS 
packet VTSP' generated by the TS packet generator 15 and non-video TS packet 
UVTSP based on the timing infonnation stored in the TS packet timing manager 18. 
The switch 16 fimctions as a multiplexer under the control of a controller 19 which 
will fiirther be described later. 

The transcoder fiirther includes a PES packet analyzer 1 1 provided between the 
video TS packet separator 10 and code converter 12, the controller 19 provided 
between the TS packet timing manager 18 and switch 16, and a TS packet buflfer 17. 
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The video TS packet separator 10 extracts a video TS packet VTSP from the 
first transport stream TS supphed from the input teraiinal IN, and provides it to the 
PES packet analyzer 11. Also, the video TS packet separator 10 exfracts, from the 
first transport stream TS, the non-video TS packet UVTSP and provides it to the TS 
packet buffer 17. Further, the video TS packet separator 10 supplies the TS packet 
timing manager 18 with timing inforaiation indicating a time at which the non-video 
TS packet UVTSP has been supplied as an input (information indicating a time at 
which the non-video TS packet appears in the first transport stream TS). 

The PES packet analyzer 11 uses the pay load of the video TS packet VTSP 
supphed from the video TS packet separator 10 to fonn a PES (packetized elementary 
stream) and provides the coder converter 12 with a encoded video signal being the pay 
load of the PES packet (will be referred to as "encoded video signal" hereinafter). 
Also the PES packet analyzer 11 provides the code converter 12 with a PTS 
(presentation time stamp) of the encoded video signal. Note here that the PTS is a 
parameter described in the header of the PES packet and indicates a time on the time 
base when the encoded video signal is to be reproduced. 

The code converter 12 converts, by the predetennined method, the encoded 
video signal generated by the PES packet analyzer 1 1 from the video TS packet VTSP 
separated by the video TS packet separator 10. For example, when the transcoder is 
used as a bit rate converter shown in FIG. 1, the code converter 12 decodes the 
encoded video signal, then re-encodes it at a predetennined bit rate (compression rate) 
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and supplies it to the TS packet generator 15. Also, the transcoder may convert codes 
concerning copyright protection infonnation, for example, appended to the encoded 
video signal. 

First, bit rate conversion will be described below. In this case, the code 
converter 12 includes an MPEG video decoder 13 and MPEG video encoder 14 as 
shown in FIG. 3. The MPEG video decoder 13 decodes the encoded video signal 
supplied from the PES packet analyzer 1 1, and provides the decoded video signal to 
the MPEG video encoder 14. The MPEG video decoder 13 will also provide the 
MPEG video encoder 14 with a PTS (presentation time stamp) corresponding to the 
video signal. The MPEG video encoder 14 re-encodes, at a predetermined bit rate 
(compression rate), the video signal supplied from the MPEG video decoder 13, and 
provides the TS packet generator 1 5 with the re-encoded video signal along with a PTS 
corresponding to the re-encoded video signal. Under the control of the controller 19, 
the TS packet generator 15 packetizes the encoded video signal supplied from the 
MPEG video encoder 14 to generate a video TS packet VTSP', and delivers it at an 
input terminal a of the switch 16. 

The switch 16 is controlled by the controller 19 to turn the output thereof to 
either the input temiinal a or b thereof The switch 16 will provide, via the output 
tenninal OUT, either the video TS packet VTSP' supplied to the input temiinal a 
thereof from the TS packet generator 15 or the second packet stream TS' generated 
by time-division multiplexing the non-video TS packets UVTSP, supplied at the input 
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tenninal b thereof from the TS packet buffer 17. 

The TS packet buffer 17 stores non- video TS packets UVTSP supplied from the 
video TS packet separator 10 and delivers them one after another at the input tenninal 
b of the switch 16. 

The TS packet timing manager 18 manages timing information supplied from 
the video TS packet separator 10 and corresponding to the non- video TS packet 
UVTSP, stored in the TS packet buffer 17 (infonnation indicating a time at which the 
TS packet UVTSP appears in the TS) and a PGR (program clock reference) indicating 
a time on the time base of the TS, and supplies them to the controller 19. 

The controller 19 controls the TS packet generator 15 and switch 16 based on 
the timing infonnation and PGR supplied from the TS packet timing manager 18. 

The transcoder constructed to convert a bit rate as in the above is used in a 
transport stream (TS) recorder shown in FIG. 4. The TS recorder records into a 
recording medium which will ftirther be described later the second transport stream 
TS' generated by multiplexing the video TS packet VTSP' whose bit rate has been 
reduced by the code converter 12 of the transcoder, and non- video TS packet UVTSP. 

The TS recorded shown in FIG. 4 includes a transcoder as shown in FIG. 1 and 
a recording system including a bit stream purser 20 to recording medium 28. 

The bit sfream purser 20 reads a PGR from TS packets supplied one after 
another from the switch 16 and provides them to a PLL (phase locked loop) block 2 1 
and other to an Arrival time stamp append block 23. The PLL block 21 locks a 27- 
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MHz clock of the recording system to the PGR suppHed from the bit stream purser 20. 
The recording system also includes a time stamp generator 22 which generates a time 
stamp based on a count of 27-MHz clocks. 

When providing a TS packet supplied from the bit stream purser 20 to a 
smoothing buffer 24 also included in the recording system, the Arrival_time stamp 
append block 23 appends to the TS packet a time stamp indicating a time at which a 
first byte of the TS packet is to be provided to the smoothing buffer 24. The 
smoothing buffer 24 stores the TS packet having the time stamp appended thereto, and 
provides it in units of a predetennined data amount appropriately to an error correction 
block 25 also included in the recording system. The error correction block 25 appends 
an error correction code to the TS packet supplied from the smoothing buffer 24 and 
provides it to a modulator 26 also included in the recording system. The modulator 
26 modulates the TS packet supplied from the error correction block 25 by a 
predetermined method, and provides it to a recorder 27 also included in the recording 
system. The recorder 27 records the modulated TS packet supplied from the 
modulator 27 to the recording medium 28. 

The transcoder used in the TS recorder functions as will be described below 
with reference to FIG. 5. Note that actually, TS packets shown in FIG. 5D are delayed 
relative to TS packets shown in FIGS. 5 A to 5C for time lengths of the operations of 
the PES packet analyzer 11 to TS packet generator 15. The non-video TS packets 
UVTSP are buffered in the TS packet buffer 17 and provided at an appropriate time 
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(as shown in FIG. 5E) to synchronize these TS packets at each time indicated with a 
broken line in FIG. 5. 

When a TS having time-division multiplexed therein video TS packets VTSP 
(indicated with "V" in FIG. 5) shown in FIG. 5A and non-video TS packets UVTSP, 
is supplied from the video TS packet separator 10 to the video TS packet separator 10, 
the latter will extract the video TS packets VTSP from the TS as shown in TIG. 5B, 
and provide them to the PES packet analyzer 1 1. The video TS packet separator 10 
will also extract the non- video TS packets UVTSP from the TS as shown in FIG. 5C, 
and provide them to the TS packet buffer 17. At the same time, the video TS packet 
separator 10 will provide the TS packet timing manager 1 8 with infonnation of a time 
at which the non-video TS packet UVTSP has been supplied. 

The PES packet analyzer 1 1 uses the pay load of the video TS packet VTSP 
supplied from the video TS packet separator 10 to provide a PES packet, and provides 
an encoded video signal being the pay load to the MPEG video decoder 13 in the code 
converter 12. The MPEG video decoder 13 decodes the encoded video signal supplied 
from the PES packet analyzer 1 1, and provides the decoded video signal to the MPEG 
video encoder 14. 

The MPEG video encoder 14 re-encodes the video signal supplied from the 
MPEG video decoder 13 at a predetennined bit rate (half of the bit rate of the TS 
packets shown in FIG. 5B when the video signal is the TS packets shown in FIG. 5D), 
and proxddes it, along with PTS to which the encoded video signal corresponds, to the 
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TS packet generator 15. Under the control of the controller 19, the TS packet 
generator 15 packetizes the encoded video signal from the MPEG video encoder 14 
as shown in FIG. 5D, and provides it to the input tenninal a of the switch 16. 

On the other hand, the TS packet buffer 17 supplies the non-video TS packets 
to the input tenninal b of the switch 16 with a delay of a predetennined time as shown 
in FIG. 5E. 

The controller 19 controls the switch 16 to turn the output thereof to its input 
tenninal a or b (as will further be described later with reference to the flow chart of 
FIG. 6). 

Thus, the video TS packets VTSP' and non- video TS packets UVTSP are time- 
division multiplexed as shown in FIG. 5F are provided from the switch 16 to the bit 
stream purser 20 located downstream of the switch 16. 

The TS packets not continuous to each other as shown in FIG. 5F will be 
rearranged to be close to each other by the downstream smoothing buffer 24 in the 
recording system shown in FIG. 4 and then recorded in the recording medium 28. 

Next, the switching by the controller 19 will be described herebelow with 
reference to the flow chart in FIG. 6, First at step SI, the controller 19 judges, based 
on the timing infomiation and PGR supplied from the TS packet timing manager 18, 
whether the present time (elapsed from a time when the video TS packet separator 10 
was supplied with TS) is a time to provide non-video TS packets UVTSP on the time 
base of the TS. If it detennines that now is not any time to provide the non- video TS 
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packet UVTSP, it goes to step S2. 

At step S2, the controller 19 judges whether the TS packet generator 15 has 
been supplied with an encoded video signal to be TS-packetized from the MPEG 
encoder 14. If it detennines that the encoded video signal to be TS-packetized is not 
supplied, it goes to step S3. 

At step S3, the TS packet generator 15 will be controlled by fhe controller 19 
to packetize the encoded video signal from the MPEG video encoder 14 and provide 
it to the input tenninal a of the switch 16. The switch 16 will be controlled by the 
controller 19 to turn an output thereof to the input terminal a and provide the video 
TS packet VTSP' supplied from the TS packet generator 15 to the downstream bit 
stream purser 20 shown in FIG. 4. 

At step S5, the controller 19 judges whether all TS packets have been provided 
to the stage downstream of the switch 16. If it determines that all the TS packets have 
not yet been provided, it goes back to step S 1 . 

If it is determined at step S 1 that the present time is a time to provide the non- 
video TS packet UVTSP, the controller 19 will go to step S4. At step S4, the switch 
16 is controlled by the controller 19 to turn the output thereof to the input tenninal b 
and provide the non-video TS packet UVTSP supplied from the TS packet buffer 17 
to the bit stream purser 20 located downstream of the switch 16. 

Thereafter, the controller 19 will go back to step SI until it determines at step 
S5 that all the TS packets have been provided, and the operations at steps SI and 
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subsequent steps are repeated. When the controller 19 detennines that all the TS 
packets have been provided, the switching control will be ended. 

As in the above, the transcoder functioning to convert a bit rate can convert only 
the bit rate of video streams contained in a TS to generate a new TS whether or not 
non- video elementary streams, contained in the TS are confomiing to MPEG-2. 

Also the transcoder can convert the bit rate of video streams contained in a TS 
irrespectively of the number of non-video elementary streams contained in the TS to 
generate a new TS. 

The TS recorder can convert only the bit rate of video streams contained in a 
TS to generate and record a new TS whether or not non-video elementary streams 
contained in the TS are confonning to MPEG-2. 

Also the TS recorder can convert the bit rate of video streams contained in a TS 
irrespectively of the number of non-video elementary streams to generate and record 
a new TS. 

Note that the present invention is applicable to decoding of a video bit stream 
forming an input multiplexed stream to generate an original signal, and re-encoding 
of the original signal to convert the bit rate of the video bit stream fonning the input 
multiplexed stream as well as to converting of codes appended to the video bit stream 
by a predetennined method, re-appending the converted code to the video bit stream 
and providing them . 

For example, the present invention is applicable to conversion by a 
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predetermined method of a code concerning a copyright protection information 
appended to a video bit stream fomiing an input multiplexed stream as shown in FIG. 
7. The transcoder in FIG. 7 is different from that shown in FIG. 2 in that a copyright 
protection inforaiation converter 30 is used instead of the code converter 12 in FIG. 
12, the output of the PES packet analyzer 1 1 is analyzed by an analyzer 31 and code 
conversion in the copyright protection information converter 30 is controlled 
according to the result of analysis from the analyzer 3 1 . 

The analyzer 3 1 analyzes the output of the PES packet analyzer 1 1 to detect 
copyright protection information such as copy control information (CCI), water mark 
signal, duplication generation infonnation limiting the number of duplications, etc. 
embedded in an input video signal. The copyright protection inforaiation converter 30 
updates, based on the result of analysis from the analyzer 31, codes concerning the 
copyright protection infonnation by a predetennined method and provides an updated 
video stream. 

For example, when the analyzer 31 detects duplication generation infonnation, 
the copyright protection infonnation converter 30 will count up the duplication 
generation information by one, if the generation limitation is within an allowable 
range, append the count to the video transport packet VTSP correspondingly to the 
PTS, and send the packet to the TS packet generator 15. 

On the other hand, when the generation limitation is beyond the allowable 
range, the copyright protection infonnation converter 30 will not provide the video TS 
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packet VTSP to the TS packet generator 15. 

Thus, the transcoder shown in FIG. 7 can provide a management to protect the 
copyright of the video transport stream. 

The transcoder shown in FIG. 7 may be combined with the recording system 
including the bit stream purser 20 thru the recording mediiun 28 shown in FIG. 4 to 
construct a TS recorder which will record TS including a video stream whose 
copyright is protected. Note that the TS recorder cannot record any TS depending 
upon the type of the copyright protection infonnation, for example, when the 
generation limitation is beyond the allowable range. 

Note that the present invention is applicable to conversion of the bit rate of a 
video stream included in a program stream or to conversion of a code appended to a 
video bit stream by a predetermined method. 

Also the present invention is applicable to conversion of the bit rate of an audio 
stream in an TS or conversion of an audio stream in a TS by a predetenuined method, 
and then multiplexing the audio stream with other elementary stream to generate a new 
TS. 

Further the present invention is applicable to conversion of the bit rate of a 
plurality of elementary streams such as both a video stream and audio stream or 
conversion of a plurality of elementary streams by a predetermined method, and then 
multiplexing them with other elementary stream to generate a new TS. 

The aforementioned series of processes can be executed by a hardware and also 
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by a software. For execution of the series of processes by a software, a program 
forming the software is installed in a computer built in a TS recorded as a dedicated 
hardware, or a general-purpose personal computer capable of perforaiing a variety of 
fiinctions with a variety of programs corresponding to the programs installed therein. 

The medium according to the present invention having recorded therein a 
program intended for execution of the above series of processes and whicli is to "be 
installed in a general-purpose personal computer which can execute the program, will 
be described herebelow with reference to FIGS. 8 A to 8C. 

The program can be provided to the user as being previously installed in a hard 
disc 302 or semiconductor memory 303, as a recording medium, incorporated in a 
personal computer 301, as shown in FIG. 8 A. 

Alternatively, the program can be provided to the user as a package software as 
being provisionally or permanently stored in a recording medium such as a floppy disc 
311, CD-ROM (compact disc-read-only memory) 312, MO (magneto-optical) disc 
313, DVD (digital versatile disc) 314, magnetic disc 315 or semiconductor memory 
3 16, as shown in FIG. 8B. 

Further, as shown in FIG. 8C, the program can be transferred by radio to the 
personal computer 301 from a download site 321 via a satellite 322 or by cable or 
radio to the personal computer 301 from the download site 32 1 via a network 331 such 
as local area network (LAN) or Internet, and stored in the hard disc 302 or the like 
incorporated in the personal computer 301. 
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The tenn "medium" referred to herein means a broad concept including all 
these media. 

The personal computer 301 incorporates a CPU (central processing unit) 342 
as shown in FIG. 9 for example. The CPU 342 has an input/output interface 345 
connected thereto via a bus 341. When supplied with a user's coimnand via the 
input/output interface 345 from an input unit 347 including a keyboard, mouse, etc., 
the CPU 342 responds to the command to load into a RAM (random access memory) 
344, and execute, a program stored in an ROM (read-only memory) 343 corresponding 
to the semiconductor memory 303 shown in FIG. 8A, a program transferred from the 
satellite 322 or network 33 1 , received by the conununication unit 348 and installed in 
the hard disc 302, or a program read out from the floppy disc 311, CD-ROM 3 12, MO 
disc 313, DVD 3 14 or magnetic disc 3 1 5 loaded in a drive 349 and installed in the hard 
disc 302. Further, the CPU 342 provides a result of a process executed thereby to a 
display unit 346 made of a LCD (liquid crystal display) or the like as necessary via the 
input/output interface 345 for example. 

Note that in this specification, steps of describing the program provided to the 
user as stored in the medium include processes effected in a time series in the 
described order as well as processes effected in parallel or individually. 

Note that the term "system" referred to herein means an entire assembly of a 
plurality of units. 
Industrial Applicability 
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As having been described in the foregoing, according to the present invention, 
a first elementary stream is code-converted to generate a first packet. Also, timing 
information indicating a time at which a second packet forming a second elementary 
stream appears in a multiplexed stream is stored. The generated first packet and 
second packet are multiplexed based on the timing infonnation, so the code of only the 
first elementary stream can be converted to generate a new second multiplexed stream 
whether or not the second elementary stream is conforming to MPEG-2. Also, it is 
possible to convert the codes of a TS havmg multiplexed therein a plurality of 
elementary streams in addition to video streams. 
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CLAIMS 



1 . A transcoder for generating, from a first multiplexed stream, a second 
multiplexed stream, comprising: 

means for separating a first elementary stream from the first multiplexed stream 
supplied; 

means for converting the first elementary streain separated by the separating 
means by a predetermined method to a signal; 

means for packetizing the signal converted by the converting means to generate 
a first packet; 

means for storing timing information indicating a time at v^^hich a packet, 
containing a second elementary stream foraiing the first multiplexed stream, appears 
in the multiplexed stream; and 

means for muhiplexing, based on the timing infonnation stored in the storing 
means, the first packet generated by the packetizing means and a second packet 
containing the second elementary streain to generate the second multiplexed stream. 

2. The apparatus as set forth in Claim 1, wherein the converting means 
includes means for decoding the first elementary stream separated by the separating 
means to generate an original signal corresponding to the first elementary stream, and 
means for encoding the original signal generated by the decoding means at a 
predetermined bit rate. 
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3. The apparatus as set forth in Claim 1, wherein the converting means 
converts, by a predetermined method, codes fomiing the first elementary stream 
separated by the separating means. 

4. The apparatus as set forth in Claim 1, wherein the multiplexing means 
multiplexes, based on the timing information stored in the storing means, the second 
packet to the second multiplexed stream at a time corresponding to the time at which 
the second packet appears in the first multiplexed stream. 

5. The apparatus as set forth in Claim 1, wherein the first elementary stream is 
a video stream. 

6. A transcoding method for generating, fi:om a first multiplexed stream, a 
second multiplexed stream, comprising the steps of: 

separating a first elementary stream fi-om the first multiplexed stream supplied; 

converting the first elementary stream separated at the separating step by a 
predetermined method to a signal; 

packetizing the signal converted at the converting step to generate a first packet; 

storing timing infonnation indicating a time at which a packet, containing a 
second elementary stream fonning the first multiplexed stream, appears in the 
multiplexed stream; and 

multiplexing, based on the timing information stored at the storing step, the first 
packet generated at the packetizing step and a second packet containing the second 
elementary stream to generate the second multiplexed stream. 
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7. The method as set forth in Claim 6, wherein the converting step comprises the 
steps of: 

decoding the first elementary stream separated at the separating step to 
generate an original signal corresponding to the first elementary stream; and 

encoding the original signal generated at the decoding step at a predetennined 
bit rate. 

8. The method as set forth in Claim 6, wherein at the converting step, codes 
forming the first elementary stream separated at the separating step are converted by 
a predetermined method. 

9. The method as set forth in Claim 6, wherein at the multiplexing step, the 
second packet is multiplexed, based on the timing infonnation stored at the storing 
step, to the second multiplexed stream at a time corresponding to the time at which the 
second packet appears in the first multiplexed stream. 

10. The method as set forth in Claim 6, wherein the first elementary stream is a 
video stream. 

11. A medium having recorded therein a transcoding program to generate, 
fi-om a first multiplexed stream, a second multiplexed stream and which is to be 
executed by a computer, the program comprising the steps of: 

separating a first elementary stream fi^om the first multiplexed stream supplied; 
converting the first elementary stream separated at the separating step by a 
predetennined method to a signal; 



26 

packetizing the signal converted at the converting step to generate a first packet; 

storing timing infonnation indicating a time at which a packet, containing a 
second elementary stream forming the first multiplexed stream, appears in the 
multiplexed stream; and 

multiplexing, based on the timing information stored at the storing step, the first 
packet generated at the packetizing step and a second packet containing the second 
elementary stream to generate the second multiplexed stream. 

12. The medium as set forth in Claim 11, wherein the converting step in the 
program comprises the steps of: 

decoding the first elementary stream separated at the separating step to 
generate an original signal corresponding to the first elementary stream; and 

encoding the original signal generated at the decoding step at a predetennined 
bit rate. 

13. The medium as set forth in Claim 1 1, wherein at the converting step in the 
prcgrain, codes fonning the first elementary stream separated at the separating step are 
converted by a predetermined method. 

14. The medium as set forth in Claim 1 1, wherein at the multiplexing step in the 
program, the second packet is multiplexed to the second multiplexed stream at a time 
corresponding to the time at which the second packet appears in the first multiplexed 
stream based on the timing information stored at the storing step. 

15. The medimn as set forth in Claim 1 1, wherein the first elementary stream is 



a video stream. 
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ABSTRACT 



In a video TS packet separator, a video TS packet VTSP is extracted from a TS 
(transport stream). In a PES packet analyzer through a TS packet generator, the video 
TS packet is decoded, re-encodes at a predetermined bit rate, TS-packetized and 
supplied to a switch input terminal. The switch input terminal is also supplied with 
non-video TS packets UVTSP from a TS packet buffer. A controller is provided to 
control the TS packet generator and switch based on timing information and PCR from 
a TS packet timing manager. Thus, codes in the TS can be converted. 



2001 ^1 ^ 11 a (11.01.2001) 




PCX 



llllillllllllllllllllllllllllllllllliillli 



(10) m^s'jkm^^ 
WO 01/03305 Al 



(51) mmm^m-': 

H04L 13/00, 12/56, H04N 7/24 



H03M 7/00, 



(21) E 

(22) ai^ajiia: 

(25) SIStilllCDtti: 

(26) mmmoimh 

(30) ^JfeUT-^: 
11/1 84681 



PCT/JPOO/04375 
2000 ^6 ^30 B (30.06.2000) 

1999 ^6 ^ 30 B (30.06. 1999) JP 



(71) iiimx(i^m^^^<±r<r>mmmiz-oi\x)i y--^ 

ifc^^h (SONY CORPORATION) [JP/JP]; =f= 141-0001 
^SICB°tiilIE:ikq°qJI|6T@7#35^ Tokyo (JP). 

(72) mM%;iS^lf 

. (75) mm^mrnxf^miz-oi^xoy^)'. mmTtm (KATo, 



Motoki) [JP/JP]; =f 141-0001 ^^||5fpJHE:lfcnnJtl6T 
i 7S35^ V --<*it#ttrt Tokyo (JP). 

(74) i-^SA: /h^fe ^, ^ (KOIKE, Akira et al.); T 105- 

0001 mstls-^E^/ P^:iTS6§4# mimtf-ii' 

Tokyo (JP). 

(81) tISIl (MfH): CN, jp KR, US. 

(84) II S II (!Lm): a - P >y (AT, BE, Ca CY, DE, 

DK, ES, Fl, FR, GB, GR, IE, IT, LU, MC, NL, FT, SE). 



! (54) Title: MET HOD AND APPARATUS FOR TRANSCODING, AND MEDIUM 
I (54)^0J(Z)€t^: h^>X3- Kg®&i;:^J£, 3fei;i3}11* 



TS 



MPEG 




MPEG 







MPEG 

r:3-^ 




MPEG 

X > n - 5r 


AS 





TS 

-7)i'i- I — *<? 

OUT 



TS- 



1 . . .TS DEMULTIPLEXER 

2. . .MPEG VIDEO DECODER 

3 . . .MPEG VIDEO -ENCODER 

4 . . .MPEG AUDIO DECODER 
m 5 . . .MPEG AUDIO ENCODER 

^ 6. . .TS MULTIPLEXER 

fO 

O (57) Abstract: A video TS packet separator extracts a video TS packet (VTSP) from a TS. A PES packet analyzer and a TS packet 
^ generator decode the video TS packet, encode again at a predetermined bit rate, and supply the TS packet to an input terminal of a 
O switch. The input terminal of the switch receives a TS packet (UVTSP) other than video from a TS packet buifer. A control section 

O controls the TS packet generator and the switch according to the timing information and PCR from a TS packet timing manager. 



Sign conversion is thus carried out for a transport stream. 



09/763760 



1/9 












a. 


MPEG 
VIDEO 
NCODEI 




MPEG 
AUDIO 
NCODE 










m 



















MPE 
VIDE 
ECOI 




MPE 
AUD 
ECOI 




a 






Q 



u. 




Oy/763760 



2/9 




CM 

d 



Oy/763760 



3/9 




CO 

d 



Oy/763760 



4/9 




0^/763760 



5/9 



-TIME 



(A) 
(B) 



(F) 



W/Mw/A W^Mm 



(C) □ 

(D) 

(E) □ 














□ 



d 














□ 



FIG.5 



09/763 



6/9 



f START OF 

SWITCHING CONTROL 



NOW IS A TIME TO 
PROVIDE NON-VIDEO TS 
PACKET? 



S2 



VIDEO DATA TO BE 
TS-PACKETIZED, 
SUPPLIED? 



YES 



TS-PACKETIZE VIDEO 
DATA AND OUTPUT 
TO DOWNSTREAM 

STAGE 



PROVIDE NON-VIDEO 
TS PACKET SUPPLIED 
FROM TS PACKET 
BUFFER TO 
DOWNSTREAM STAGE 



S4 



S3 



ALL TS PACKETS, 
PROVIDED 



S5 



( END ) 



FIG.6 



0^/763760 



7/9 




1^ 



Oy/763760 




09/763760 



9/9 




PTO/SB 106 (5-00) 
Approved for use through 10/31/02. 0MB 0651-0032 
Patent and Trademark Office: U.S. DEPARTOENT OF COMMERCE 
Under the Paperwork Reduction Act of 1 995, no persons are required to respond to a collection of information unless it displays a valid 0MB control number 

Declaration and Power of Attorney for Patent Application 

Japanese Language Declaration 



As a below names inventor, I hereby declare that: 



My residence, post office address and citizenship are as stated 
next to my name: 



£-3 Ts2®:S»ffl^i!8K^v>T. ^if93;«HU5B«*h» B.-^mi}' 



« C r> v» T 45? ffi K * HiS 1 4 eSibf * 4 C * S 6 i , 



I believe I am the original, first and sole inventor(if only one 
name is listed below) or an original, first and joint inventor (if 
plural names are listed below) of the subject matter which is 
claimed and for which a patent is sought on the invention 
entitled. 



TR/yMSGOHING APPARATUS, METHOD AMD MEDIUM 



the specification of which is attached hereto unless the 
following box is checked: 



Q was filed on June 30. 2000 

as United States Application Number of 

PCT International Application Number PCT/JPOO/043 75 

and was amended on 

(if applicable). 



I hereby state that I have reviewed and understand the contents 
of the above identified specification, including the claims, as 
amended by any amendment referred to above. 



I acknowledge the duty to disclose information which is 
material to patentability as defined in Title 37, Code of Federal 
Regulations, Section 1 .56. 



Burden Hour Statement: This form is estimated to take 0.4 hours to complete. Time will vary depending upon the need of the individual case. Any comments on the 
amount of time you are required to complete this form should be sent to Chief Information Officer, U.S. Patent and Trademark Office. Washington. DC 20231 DO 
NOT SEND FEES OR COMPLETED FORMS TO THIS ADDRESS. SEND TO: Commissioner of Patents and Trademarks, Washington. DC 20231 . 



Page 1 of 3 



sha0062 



Japanese Language Declaration 



5 SSI 3 5 5*(8)ici3P CTKBSfflHicoOT. 1 1 9 Si (a) 

^nmtf:<im^&<DSi&. mut? cTDaKifliss(c-7v>Tii. 

Prior Foreign Application(s) 



1 1-18^1 
(Number) 
(*^) 

P CT/JPOO/0 4375 
(Number) 



(Country) 
(Country) 



hereby clam foreign priority under Title 35, United States Code, 
Section n9(a)-(d) or 365(b) of any foreign application(s) for patent or 
inventor's certificate, or 365(a) of any PCT International application 
which designated at least one country other than the United States listed 
below and have also identified below, by checking the box, any foreign 
application for patent or inventor's certificate or PCT international 
application having a filing date before that of the application for which 
priority is claimed. 

Priority Not Claimed 



30 June 1999 
(Day/Month/Year Filed) 



30 June 2£W 
(Day/Month/Year Filed) 



^umber) 



(Country) 



(Day/Month/Year Filed) 



(Day/Month/Year Filed) 



□ 
□ 



.^umber) 



(Day/Month/Year Filed) 



.JSfumber) 
B^(S^) 



f4J)plication No.) 



(Filing Date) 



tc BIfo « *5 <£ Rf K EC T W*«S*f « 4 c £ **Sf 4. 



(Day/Month/Year Filed) 

I hereby claim the benefit under Title 35, United States Code, Section 
1 19(e) of any united States provisional application(s) listed below. 



(Filing Date) 
(fflHB) 



I hereby claim the benefit under Title 35, United States Code, Section 
120 of any United States application(s), or 365© of any PCT 
international application designating the United States, listed below and, 
insofar as the subject matter of each of the claims of this application is 
not disclosed in the prior United States or PCT International application 
in the manner provided by the first paragraph of Title 35, United States 
Section 112, I acknowledge the duty to disclose information which is 
material to patentability as defined in Title 37, Code of Federal 
Regulations, Section 1.56 which became available between the filing 
date of the prior application and the national or PCT international filing 
date of application. 



(Filing Date) 



(Status: Patanted, Pending, Abandoned) 



SI 0 0 I«t3£-:JS. tlAtiHii^^. ^Kli^o^^S 



I hereby declare that all statements made herein of my own 
knowledge are true and that all statements made on information 
and belief are believed to be true; and further that these 
statements were made with the knowledge that willful false 
statements and the like so made are pimishable by fine or 
imprisonment, or both, under Section 1001 of Title 18 of the 
United States Code and that such willful false statements may 
jeopardize the validity of the application or any patent issued 
thereon. 



Japanese Language Declaration 



Ch) ^ 



POWER OF ATTORNEY: As a named inventor, I hereby appoint 
the following attomey(s) and/or agent(s) to prosecute this application 
and transact al business in the Patent and Trademark Office 
connected therewith (iist name and registration number) 

) WILLIAM S. FROMMER, Registratiot^4Jer^S06-and 
DENNIS M. SMID, Registration Mo-M-jaafl 



Send Correspondence to: ] 

WILLL^iM S. FROMMER, Esq. 

c/o FROMMER LAWRENCE & HAUG LLP 

745 Fifth Avenue 

New York, New York 10151 



Direct Telephone Calls to: 
(212) 588-0800 
to the attention of: 
WILLIAM S. FROMMER 













\ 








- SBf 


m 





.0 



Full name of sole or first inventor 



mventor's signatur^t°*- ^ Date 
Re^dence (/ 



4d 



2 f, j-opf 



Citizenship 

J^3an 

Post Office Address 

c/o Sony Corporation, 7-35, Kitashinagawa S-chome, 
Shin^gawa-ku, Tokyo 141-0001 Zsgsci 



fijH name of second joint inventor, if any 



Second Inventor's signature 



Post Office Address 



(Supply similar information and signature for third and subsequent 
joint inventors) 



